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SOFT INPUT - SOFT OUTPUT FORWARD ERROR CORRECTION 
DECODING FOR TURBO CODES 

BACKGROUND OF THE INVENTION 

This application claims priority under 35 USC § 1 19(e) from U.S. Provisional 
application Serial No. 06/231,682 entitled "Soft Input Soft Output Forward Error 
Correction Decoding For Turbo Codes" and filed September 11, 2000, and is related to 
U.S. Patent No. 5,930,272 by Thesling, entitled "Block Decoding With Soft Output 
Information" filed June 10, 1997 and issued July 27, 1999, the entirety of which is 
incorporated herein by reference. 

FIELD OF THE INVENTION 

This invention is related generally to the decoding of linear block codes, and more 
specifically to a method of soft input-soft output decoding. 

DESCRIPTION OF THE RELATED ART 

The transmission of digital information has become, and will continue to be, the 
most common form of communications for years to come. Digital communication links 
in the form of satellite communications systems, wireless LANs, digital cellular 
communications systems, digital video broadcast, and many others, are used for the 
efficient and flexible transmission of a wide variety of data services. However, in most, 
if not all cases, the digital data is subjected to imperfect transmission mechanisms which 
introduce various levels of noise into the transmitted signal and threaten the reliability of 
the transmitted data at the receiving end. As a result, designers have continued to 
develop error-detecting and correcting tools in an effort to improve data reliability in 
communications regimes. 

Forward error correction is the capability of a receiving station to correct a 
transmission error, and can increase throughput of a data link operating in a noisy 
environment. The transmitting station appends information to the data in the form of 
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error correction bits, however, the number of error correction bits also impacts the size of 
the transmitted word, which ultimately effects the bandwidth of the data channel 
Therefore, the number of error-correction bits must be chosen with bandwidth, and other 
factors in mind. 

5 Turbo codes are a relatively new class of correction codes which represent the 

next leap forward in error correction. The designer has more flexibility to determine the 
required transmission energy, bandwidth, and system complexity with the increased 
error-correction performance offered by turbo codes. Turbo codes break a complex 
decoding problem into simple steps. Each step is then repeated until a solution is 

10 reached. The complexity of convolutional codes has slowed the development of low-cost 
turbo convolutional decoders. However, turbo product codes offer substantially higher 
data throughput in hardware at a more reasonable cost by solving multiple steps 
simultaneously. As a result, turbo product codes are receiving more attention in 
advanced terrestrial and satellite communications systems due to their unmatched error- 

1 5 correction capability. 

A sequence of logical Is and 0s in a digital message is typically sent from a 
source device through a channel medium to a decoder at a destination end for decoding. 
However, before transmission, the logical Is and 0s are converted into voltages, and 
transmitted through the channel medium as +1 volt and -1 volt, respectively. Channel 

20 noise is inherently introduced into the voltage signal which is received by the receiver at 
the destination device. The decoder at the destination device will then make a hard 
decision based upon the received voltage signals. (With a threshold placed at 0 volts, a 
value greater than or equal to 0 volts is interpreted as a logical 1, and a value less than 
0 volts is interpreted as a logical 0.) This is termed hard decision decoding (HDD), since 

25 each symbol, as first represented by a voltage, is converted to logical Is and 0s prior to 
decoding. Soft decision decoding utilizes more information than the logical Is and 0s by 
utilizing the received voltage signals, usually quantized to three or four bits. 

Turbo coding (also called "iterative" decoding) of product codes (and variances 
thereof) requires the use of a decoder that uses soft information as input ("soft input 

30 information"), and yields soft information at the output ("soft output information"). Soft 
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information is a more detailed measure of received channel information. Soft input 
information to a decoder is that which indicates what value each received bit is assigned 
(e.g., a logical 1 or 0) 3 and an associated value that indicates the reliability or confidence 
that the value assigned to the particular received bit is correct. The decoder then uses the 

5 soft input information to decode the received information to produce an estimate of the 
original transmitted data. Soft output information of a decoder is that information which 
not only provides an accurate estimate of the original message, but also reliability or 
confidence information as to the likelihood that the decoded bit is correct. Decoding 
with soft input information yielding soft output information is called SISO (Soft Input- 

10 Soft Output) decoding. 

Prior art SISO turbo decoding algorithms are complex, bandwidth-intensive, and 
costly to implement. What is needed is an efficient and more cost effective algorithm 
which is easier to implement and exhibits near optimal SISO decoding with a tiny 
fraction of the complexity of the prior art decoding algorithms. 
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SUMMARY OF THE INVENTION 



The invention disclosed and claimed herein, in one aspect thereof, is a method of 
decoding a block or vector of data. A vector of data is received from the channel The 

5 vector of data is then processed to output a final code word of bits. A final reliability 
vector of reliability values associated with the final code word is generated such that each 
bit of the final code word of bits has a corresponding reliability value in the final 
reliability vector. Corresponding reliability values for one or more bit positions of the 
final code word are determined by a difference of distance metrics, and corresponding 

10 reliability values for one or more bit positions of the final code word are determined 
utilizing a numerical approximation. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



For a more complete understanding of the present invention and the advantages 
thereof, reference is now made to the following description taken in conjunction with the 
5 accompanying Drawings in which: 

FIG. 1 illustrates a flow chart of the general process of the disclosed SISO-TC 
algorithm; 

FIG. 2 illustrates a flow chart of one method of decoding, according to a disclosed 
embodiment; 

10 FIG. 3 illustrates a flow chart of a second decoding method, according to a 

disclosed embodiment; and 

FIG. 4 illustrates a flow chart of a third decoding method, according to a 
disclosed embodiment. 
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DETAILED DESCRIPTION OF THE INVENTION 



Disclosed herein is a new and efficient algorithm, the SISO-TC (Soft Input-Soft 
Output - Third Chance) algorithm, for achieving near optimal SISO decoding with less 
5 complexity then prior art SISO decoding architectures, and with soft output information. 
In addition to yielding an output bit sequence, a measure of the reliability of each output 
bit in that sequence is available as well. This is important for turbo decoding since soft 
output information is required as soft input information for the subsequent decoding step. 
The SISO-TC algorithm generates soft output information for each bit of the 

10 output code word based upon a difference of correlation values, or some other metric 
substantially equivalent to correlation such as the difference metric as given in Equation 
52 of the dissertation by Thesling, William K, Efficient Block Decoding Algorithms 
Exploiting Channel Measurement Information, Department of Engineering, 
Cleveland State University, December 1995, the entirety of which is incorporated by 

15 reference, where the code words exist to compute these metrics, but uses an 

approximation for the remaining bit positions for which there are no code words to 
compute the difference of correlation values (or difference metrics). The disclosed 
algorithm generates a subset of code words required in prior art systems, which results in 
implementation of a less complex and more cost effective decoding architecture. 

20 

General Decoding Method 

Referring now to FIG. 1, there is illustrated a flow chart of the general decoding 
process of the disclosed SISO-TC algorithm. Flow begins when the destination device 
decoder samples a vector of data from the data channel, as indicated in a function block 

25 100. Flow continues to a function block 102 where a first candidate code word is 

generated, along with a companion reliability vector. This first reliability vector is used 
as an input to subsequent decoding to develop a second candidate code word. The first 
and second candidate code words and associated reliability vectors are used as an input to 
a subsequent decoding to develop a third candidate code word. A third candidate code 

30 word is then generated, as indicated in a function block 106, along with a third reliability 
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vector. There now exist three candidate code words. The second and third candidate 
code words along with their reliability vectors do not need to be explicitly calculated. It 
is only necessary to calculate and store how these code words and reliability vectors 
differ from the first candidate. 
5 Flow continues to a function block 108 to determine the distance metrics 

associated with each candidate code word. The code words are then ranked based upon 
the values of the distance metrics, as indicated in a function block 110. In accordance 
with the rank of the distance metrics, a predetermined set of output reliability vector 
equations are then chosen, as indicated in a function block 112, In accordance with the 

10 chosen set of reliability equations, selected positions of the output reliability vector are 
determined based upon a difference of distance metrics, as indicated in a function block 
1 14. For the remaining positions of the reliability vector, an approximation calculation is 
used, as indicated in a function block 1 16. Flow continues to a function block 118 where 
the resulting code word and corresponding reliability vector are output. The process then 

15 reaches a stopping point. 

Decoding Method No. 1 

Referring now to FIG. 2, there is illustrated a flow chart of one method of 
decoding, according to a disclosed embodiment. The decoding algorithm begins with a 

20 function block 200 where a vector of channel data is sampled from a channel of 

information. The size (or number of bits) of the sampled vector data is determined in 
accordance with the particular coding implementation. The sampled data, in as much as 
it is sampled from the physical medium in a bipolar voltage format, is then converted into 
sign-magnitude notation, as indicated in a function block 202. (Note that 

25 implementations in 2's complement can be achieved as well.) Flow continues to a 

function block 204 where the sign data is extracted and placed into a new vector called a 
hard decision vector (HDV). Magnitude data of the received vector bits is placed into 
another vector called a reliability vector (RV), as indicated in a function block 206. 

The following decoding steps are explained with respect to a (16,1 1) Extended 

30 Hamming code, but can be applied to all Hamming codes. Extensions can be made to 
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codes having a greater Hamming distance including, but not limited to, for example, 
BCH (Bose, Chaudhuri, Hocquenghem) codes and Golay codes. 

The decoding steps for SISO decoding of the (16,1 1) Extended Hamming code 
continue by performing hard decision decoding (HDD) on the HDV, as indicated in a 
5 function block 208. The disclosed decoding algorithm must force decoding of the HDV 
to a code word, which can be accomplished with Extended Hamming codes by 
complementing the extended bit position (i.e., the appended parity bit) whenever a parity 
error is found. This resulting "corrected" vector is then designated the Hard Decision 
Decoded Vector (HDDV), as indicated in a function block 210. Flow continues to a 

10 function block 2 12 where the bit positions of the RV which correspond to the alleged bits 
in error in the HDV, are then 2's complemented in the RV (i.e., these corresponding bit 
positions in the RV are negated, if any errors were alleged in these bit positions in the 
HDDV.) Flow continues to a function block 214 to determine the positions of the five 
lowest values in the RV. Note that the number of lowest values is determined in 

15 accordance the minimum distance of the code being used. There is not a hard-and-fast 
rule, but it is preferred to be one more then the minimum distance of the code. Thus for 
Extended Hamming codes, this number is 4+1, or 5. (The bit positions found in blocks 
208 and 210 are guaranteed to be part of these five positions.) Call these positions M0, 
Ml, M2, M3, and M4, corresponding in order of lowest to highest values found. 

20 A copy of the HDDV is then made, as indicated in a function block 2 1 6, and the 

bit positions of the three lowest values M0, Ml, and M2 of the five (M0-M4) are then 
complemented, as further indicated in a function block 218. This new vector is 
designated the Second Chance Algorithm Input (SCAI) vector. Flow continues to a 
function block 220 where HDD is performed on the SCAI vector. The code word output 

25 from this HDD process is designated the SCA (Second Chance Algorithm). The bit 
positions alleged to be in error by the hard decision decoding (one bit position is 
guaranteed to be found for extended Hamming codes) are the noted. This bit position 
alleged to be in error is then denoted as MX. Flow continues to a function block 222 
where a copy of the HDDV is made. The bit positions of the two lowest values M0 and 

30 Ml are then complemented, as indicated in a function block 224. Flow is to a decision 
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block 226 to determine if MX is equal to M3. If so, flow is out the "Y" path to a function 
block 228 to complement position M4. This vector is then designated the Third Chance 
Algorithm Input (TCAI) vector. If MX is not equal to M3, bit position M3 is 
complemented (i.e., negated) instead of bit position M4, and the vector is designated, 
5 again, the TCAI vector, as indicated in a function block 230. Flow is then to a function 
block 232 to perform HDD on the TCAI vector. The output code word is designated the 
Third Chance Algorithm (TCA) vector, and the positions alleged to be in error in the 
HDD process are noted (one bit error is guaranteed to be found). This new error position 
is denoted MY. 

10 At this point, there exists three candidate code words (or vectors); HDDV, SCA, 

and TCA. Each code word has a distance metric (DM) associated therewith. The DM 
for the HDDV code word is denoted DM(HDDV), and similarly for DM(SCA) and 
DM(TCA). The following definitions are then made, as indicated in a function block 
234: DM(HDDV) = 0; DM(SCA) = RV(MO) + RV(M1) + RV(M2) + RV(MX); and 

15 DM(TCA) = RV(MO) + RV(M1) + (RV(M3) or RV(M4), per the procedure of blocks 
222-230, meaning blocks 222, 224, 226, 228, and 230) + RV(MY). 

Flow continues to a function block 236 where DM(HDDV), DM(SCA), and 
DM(TCA) are calculated, ranked from the lowest to highest value, and assigned to DM0, 
DM1, and DM2, respectively, as indicated in a function block 238. Flow continues to a 

20 function block 240 where the output vector (HDDV, SCA, or TCA) which has a 

minimum DM, is chosen. (Note that bit positions M0 and Ml each may be a negative 
value due to the 2's complementing.) Flow is then to a function block 242 where the 
appropriate set of equations are selected for determining the output reliability vector 
RVO according to the order of the distance metrics DM0, DM1, and DM2. The RVO is 

25 then generated using a difference of distance metrics (DM0, DM1, and DM2) for some of 
the bit positions, and by using a lambda approximation for the remaining positions, as 
indicated by a function block 244. Flow then continues to a Stop block. At this point, 
flow could return processing of the decoding algorithm to function block 200 to process 
the next sampled data vector. 
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Selection of output reliability vector (RVO) is then determined in accordance 
with the relationship of the candidate code word DM's. 

a) If the minimum (or lowest value) distance metric DM0 = DM(HDDV), and the 
2 nd minimum distance metric DM1 = DM(SCA), then: 

5 RVO(MO) = DM1 - DM0 = DM(SCA) - DM(HDDV) = RV(MO) + RV(M1) + 

RV(M2) + RV(MX); 

RVO(Ml) = DM1 - DM0 = DM(SCA) - DM(HDDV) = RV(MO) + RV(M1) + 
RV(M2) + RV(MX); 

RVO(M2) = DM1 - DM0 = DM(SCA) - DM(HDDV) = RV(MO) + RV(M1) + 
10 RV(M2) + RV(MX); 

RVO(MX) = DM1 - DM0 = DM(SCA) - DM(HDDV) = RV(M0) + RV(M1) + 
RV(M2) + RV(MX); 

RVO(M3 or M4, per blocks 226-230) = DM2 - DM0 = DM(TCA) - DM(HDDV) 
= RV(M0) + RV(M1) + (RV(M3) or RV(M4), per the procedure of blocks 222-230) + 
15 RV(MY); (Note that depending upon how the decoding progresses, MX could be M3, or 
M4, or something else. If it is, then that one of M3 or M4 becomes part of SCA, and the 
other one becomes part of TC A. If MX is neither M3 or M4, then M3 becomes part of 
TCA; but M4 is only part of TCA if MY=M4.) 

RVO(MY) = DM2 - DM0 = DM(TCA) - DM(HDDV) = RV(M0) + RV(M1) + 
20 (RV(M3) or RV(M4), per the procedure of blocks 222-230) + RV(MY); and 

RVO(J) = RV(M0) + RV(M1) + RV(J) + XRV(M4) - DM0, where J is all other 
positions. 

b) If the minimum distance metric is DM0 = DM(HDDV), and the 2 nd minimum 
distance metric is DM1 = DM(TCA), then: 

25 RVO(MO) = DM1 - DM0 = DM(TCA) - DM(HDDV) = RV(M0) + RV(M1) + 

(RV(M3) or RV(M4), per the procedure of blocks 222-230) + RV(MY); 

RVO(Ml) = DM1 - DM0 = DM(TCA) - DM(HDDV) = RV(M0) + RV(M1) + 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) + RV(MY); 

RVO(M2) = DM2 - DM0 = DM(SCA) - DM(HDDV) = RV(M0) + RV(M1) + 
30 RV(M2) + RV(MX); 
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RVO(MX) = DM2 - DMO = DM(SCA) - DM(HDDV) = RV(M0) + RV(M1) + 
RV(M2) + RV(MX); 

RVO(M3 or M4, per blocks 226-230) = DM1 - DMO = DM(TCA) - DM(HDDV) 
= RV(MO) + RV(M1) + (RV(M3) or RV(M4), per the procedure of blocks 222-230) + 
RV(MY); 

RVO(MY) = DM1 - DMO = DM(TCA) - DM(HDDV) = RV(M0) + RV(M1) + 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) + RV(MY); and 

RVO(J) = RV(MO) + RV(M1) + RV(J) + XRV(M4) - DMO, where J is all other 
positions. 

c) If the minimum distance metric DMO — DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) = DM1 - DMO = DM(HDDV) - DM(SCA) = - RV(MO) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(Ml) = DM1 - DMO = DM(HDDV) - DM(SCA) = - RV(M0) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(M2) = DM1 - DMO = DM(HDDV) - DM(SCA) = - RV(M0) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(MX) = DM1 - DMO = DM(HDDV) - DM(SCA) = - RV(MO) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(M3 or M4, per blocks 226-230) = DM2 - DMO = DM(TCA) - DM(SCA); 

RVO(MY) = DM2 - DMO = DM(TCA) - DM(SCA); and 

RVO(J) = RV(J) + XRV(M4) - RV(M2) - RV(MX), where J is all other positions. 

d) If the minimum distance metric DMO = DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(TCA), then: 

RVO(MO) = DM2 - DMO = DM(HDDV) - DM(SCA) = - RV(M0) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(Ml) = DM2 - DMO = DM(HDDV) - DM(SCA) = - RV(M0) - RV(M1) - 
RV(M2) - RV(MX); 

RVO(M2) = DM1 - DMO = DM(TCA) - DM(SCA) = (RV(M3) or RV(M4), per 
the procedure of blocks 222-230) + RV(MY) - RV(M2) - RV(MX); 
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RVO(MX) = DM1 - DM0 = DM(TCA) - DM(SCA) = (RV(M3) or RV(M4), per 
the procedure of blocks 222-230) + RV(MY) - RV(M2) - RV(MX); 

RVO(M3 or M4, per blocks 222-230) = DM1 - DM0 = DM(TCA) - DM(SCA); 
RVO(MY) = DM1 - DM0 = DM(TCA) - DM(SCA); and 

RVO(J) = RV(J) + fcRV(M4) - RV(M2) - DM(MX), where J is all other positions. 

e) If the minimum distance metric DM0 = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) = DM1 - DM0 = DM(HDDV) - DM(TCA) = - RV(M0) - RV(M1) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(Ml) = DM1 - DM0 = DM(HDDV) - DM(TCA) = - RV(M0) - RV(M1) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(M2) - DM2 - DM0 = DM(SCA) - DM(TCA) = RV(M2) + RV(MX) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(MX) = DM2 - DM0 = DM(SCA) - DM(TCA) = RV(M2) + RV(MX) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(M3 or M4, per blocks 226-230) = DM1 - DM0 = DM(HDDV) - DM(TCA) 
= - RV(M0) - RV(M1) - (RV(M3) or RV(M4), per the procedure of blocks 222-230) - 
RV(MY); 

RVO(MY) = DM1 - DM0 = DM(HDDV) - DM(TCA) = - RV(M0) - RV(M1) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); and 

RVO(J) = RV(J) + fcRV(M4) - (RV(M3) or RV(M4), per the procedure of blocks 
222-230) - RV(MY), where J is all other positions. 

f) If the minimum distance metric DM0 = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(SCA), then: 

RVO(MO) = DM2 - DM0 = DM(HDDV) - DM(TCA) = - RV(M0) - RV(M1) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(Ml) = DM2 - DM0 = DM(HDDV) - DM(TCA) = - RV(M0) - RV(M1) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(M2) = DM1 - DM0 = DM(SCA) - DM(TCA) = RV(M2) + RV(MX) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 
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RVO(MX) = DM1 - DM0 - DM(SCA) - DM(TCA) = RV(M2) + RV(MX) - 
(RV(M3) or RV(M4), per the procedure of blocks 222-230) - RV(MY); 

RVO(M3 or M4, per blocks 226-230) = DM1 - DM0 = DM(SCA) - DM(TCA); 

RVO(MY) = DM1 - DM0 = DM(SCA) - DM(TCA); and 
5 RVO(J) = RV(J) + ARV(M4) - (RV(M3) or RV(M4), per the procedure of blocks 

222-230) - RV(MY), where J is all other positions. 

The constant X is a multiplying constant which is determined by trial and error. A 
method for arriving at the estimation parameter is described in greater detail hereinbelow, 
A range of values of X from X=2 to A,=7, inclusive, has been found to yield good results 
10 for many Hamming codes and Extending Hamming Codes with 5 bits of channel soft 
information (5 bits of quantization). Clearly, using only one additional decoding instead 
of two, would work, albeit at a reduced performance (SCA only). Extensions to a 4 th and 
5 th decoding pass, and beyond, are possible. 

For codes with higher minimum distances, the technique can be made to work, 
15 however, the choice of alternate code word patterns needs to be determined. 

(16,11) Extended Hamming Code Example 

The following example addresses a scenario where two errors are introduced into 
the transmitted vector s, and will be discussed in conjunction with the steps illustrated in 
20 the flow chart of FIG. 2. Let the (16,1 1) code word which will be transmitted across the 
channel be the binary vector f = (l 1 1 0 0 1 1 1 0 1 0 1 0 0 1 1). Voltage 
conversion of the binary symbols of the binary vector t results in a transmitted vector s 
being the following: 

25 J = (+1 +1 +1 -1 -1 +1 +1 +1 -1 +1 -1 +1 -1 -1 +1 +1). 

Channel noise e introduced into the transmitted vector s results in a noisy received word r 
having errors in bit positions one and three (from the left, and underlined). If the noisy 
received vector r, with errors in bit positions one and three, has the following voltages 
30 representing the corresponding bit positions of the transmitted vector s 9 the noisy 
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received vector r, as sampled in accordance with the step in function block 200, could be 
the following: 

GQX +1.1, zQX -0.9, -1.3, +1.2, +0,4, +1.0, -0.9, +1.7, -1.1, +0.3, -1.5, -LI, +0.9, +0.7). 

5 

The noisy received vector r is then converted into two vectors: the HDV and the RV, as 
indicated in function block 202. The HDV, as before, is derived from the sign data of the 
noisy received vector r, as indicated in function block 204, and forms the following 
binary vector which inserts a zero bit for a negative value in the noisy received vector r, 
10 and a one bit for a positive value: 

HDV = (0 1 0 0 0 1 1 1 0 1 0 1 0 0 1 1). 

The RV is derived from the absolute value of the symbol voltages of the noisy received 
15 vector r, as indicated in function block 206, and becomes: 

RV = GU*1.1, OX 0.9, 1.3, 1.2, 0.4, 1.0, 0.9, 1.7, 1.1, 0.3, 1.5, 1.1, 0.9, 0.7). ' 

The next step is to perform hard decision decoding on the HDV, and designate the output 
20 code word as HDDV, as indicated in function block 208. This process uses the parity 
bits to find and correct the binary errors. The (16,1 1) code word has a minimum 
Hamming distance of four, which means that any two code words are different in at least 
four bit positions. Since there are 1 1-bit messages, there are 2 11 (or 2048) possible 
transmitted code words. There are 2 16 possible received HDVs. If an HDV is different 
25 from one of the '2048 code words by only one bit position (or it is an exact match), then 
the resulting HDDV is defined to be that one HDV code word. In a practical 
implementation, finding the "closet" code word is found by recomputing the parity bits, 
and testing the block of recomputed parity bits with the block of original parity bits. If 
there is agreement, there are no errors in the HDV, therefore, HDDV = HDV. If there is 
30 no agreement, the positions in disagreement can be used to compute the location of the 
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error. One error can be detected and corrected. Two errors can be detected, but not 
corrected with any reliability, since there are sixteen code words having a distance two 
from any double-error HDV. The mapping of parity bits which do not agree (also called 
the syndrome) to the "alleged" error pattern can be accomplished via a look-up table. An 
5 exemplary HDDV could then be the following: 

HDDV = HDD(HDV) = (0 10001010101001 0). 

In this example, hard decision decoding of the HDV alleged additional errors in positions 
10 7 and 16, and "corrected" these positions by converting them to zero bits. Now the 
HDDV has a total of four bits in error, i.e., positions 1, 3, 7 and 16. Note that the 
disclosed algorithm requires that HDDV must be a code word, thus, when HDD of the 
HDV is performed, the result will be forced to a code word. Therefore, the HDDV is a 
code word. 

15 In accordance with the step associated with function block 212 of FIG. 2, the two 

positions in the RV which correspond to the erroneous bit positions (7 and 16) of the 
HDV, are now 2's complemented, which in a binary regime, is a convenient way of 
representing negative numbers. Therefore, corresponding reliability values in the RV at 
positions alleged to be in error by HDD (positions 7 and 16) are replaced with negative 

20 values. Let RVe be this augmented RV, such that RVe = RV(HDDV), and is represented 
by the following vector: 

RVe = (0.1 1.1 0.2 0.9 1.3 1.2 =0A 1,0 0.9 1.7 LI 0.3 1.5 LI 0.9 -0.7 ). 

25 HDDV and RVe are now consistent with HDV and RV, respectively, since bits were 
changed in the HDDV, and corresponding reliability values in RVe were made negative. 
(Note that a logical 1 with reliability X is equivalent to a logical 0 with reliability -X.) 

In accordance with the step associated with function block 214, the positions in 
the augmented vector RVe having the five lowest values are denoted M0, Ml, M2, M3, 

30 and M4, in ascending order. These five lowest values are associated, in ascending order, 
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with positions 16, 7, 1, 3, and 12. Therefore, MO = -0.7, Ml = -0.4, M2 = 4-0.1, M3 = 
+0.2, and M4 = +0.3. The five lowest values are selected based upon the distance 
structure of the code. This turns out to be five for all Extended Hamming codes, from 
(8,4) to (256,247), and beyond. 
5 In accordance with function block 2 1 6, the HDDV is then duplicated in 

preparation for complementing the three lowest values (M0, Ml, and M2), and denoting 
the resulting vector the SCAI vector, as indicated in function block 218. The 
complemented positions are underlined. 

10 HDDV (complemented) = SCAI -(1 10001110101001 1). 

In accordance with function block 220, the next step is to perform HDD on the 
SCAI, and denote the resulting vector SCA. Hard decision decoding will allege one error 
(e.g., in position three) since it is an Extended Hamming code. The position in error is 
15 then denoted MX. Therefore, the SCA vector is: 

SCA = HDD(SCAI) = (1 1 1 0 0 1 1 1 0 1 0 1 0 0 1 1). 

Notice that the resulting SCA code word is the transmitted binary code word L Position 
20 3 (underlined) is alleged to be in error. Also note that for Extended Hamming codes, 

hard decision coding of the SCAI will always allege one, and only one position, in error. 

This is a nice property of Extended Hamming codes, but it is not the case for codes with 

higher minimum distances, in general. 

The positions of the two lowest values (M0 and Ml) are then complemented in a 
25 copy of the HDDV, as indicated in function block 224. 

HDDV (M0 and Ml complemented) -(0 10001110101001 1) 

As indicated hereinabove, the two lowest positions M0 and Ml occur at positions 16 and 
30 7, respectively. A third lowest position is needed. Since position 3 is already tagged as 
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MX, M3 cannot be used, since it too is pointing to position 3. So the position having the 
next larger value is selected, the position associated with tag M4, or in this case position 
12. If the step associated with function block 214 had found something other then 
position 3, then position 3 could have been used for the third lowest value position. The 
5 position associated with the selected third position is then complemented (shown 
underlined), resulting in the following vector, denoted TCAI: 

TCAI - HDD V(M4 complemented) = (0 10001 1 10101001 1), 

10 Hard decision decoding is then performed on TCAI, as indicated in function block 232, 
and will allege one position in error, since the code word is an Extended Hamming code 
word, e.g., position 14 (shown underlined), resulting in a vector denoted TCA: 

TCA = (0 10001110100011 1). 

15 

This alleged error position will, of course, depend on the code structure itself, and 
position 14 is just an example. It may be almost anywhere, but will not be positions 16, 
7, 1, or the third position used (position 12). Because the step of function block 214 
found position 3, position 3 will not be alleged in error. (Note that the positions alleged 

20 to be in error in the steps associated with blocks 220, 222, 224, 226, 228, and 230, are 
guaranteed to be different). Note also that HDDV is a code word. If three positions are 
complemented, HDD can only find one more position (HDD could in theory find two, 
but if it did, the result would not satisfy the overall parity condition, so the HDD process 
will find one, and only one, position). This position must be different from the first three 

25 in order to obtain a total of four positions different. 

HDD is then performed on the TCAI vector, as indicated in function block 232, 
and the resulting output vector is denoted TCA. Note that one position is guaranteed to 
be in error, and this error position is denoted MY. 

30 TCA = HDD(TCAI)-(0 10001110100011 1) 
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Summarizing to this point, there are three candidate code words (i.e., vectors) 
called HDDV, SCA, and TCA, and the augmented reliability vector RVe. 

5 HDDV = HDD(HDV) = (0 10001010101001 0); 

SCA = HDD(SCAI) = (1 1 1 0 0 1 1 1 0 1 0 1 0 0 1 1); 
TCA = HDD(TCAI) = (0 1 0 0 0 1 1 1 0 1 0 0 0 1 1 1); and 
RVe = (0.1, 1.1,0.2, 0.9, 1.3, 1.2, -0.4, 1.0, 0.9, 1.7, 1.1,0.3, 1.5, 1.1,0.9, -0.7). 

10 Additionally, a number of bit positions have been tagged; M0(position 16) = -0.7, 

Ml(position 7) = -0.4 , M2(position 1) = +0.1 , M3(position 3) = +0.2, M4(position 12) = 
+0.3, MX(position 3) = +0.2 and MY(position 14) = 1.1. 

As noted hereinabove, each code word has distance metrics (DM) associated 
therewith. As indicated in function block 234, the DM for HDDV is denoted 

15 DM(HDDV), similarly DM(SCA), and DM(TCA), and each are calculated in accordance 
with the previous definitions (as further indicated in function block 236), as follows: 
DM(HDDV) = 0; DM(SCA) = RV(M0) + RV(M1) + RV(M2) + RV(MX) = - 0.7 - 0.4 + 
0.1 + 0.2 = - 0.8; and DM(TCA) = RV(M0) + RV(M1) + (RV(M3) or RV(M4), as per 
function block 214) + RV(MY) = -0.7 - 0.4 + 0.3 + 1.1 = 0.3. 

20 The distance metrics DM(SCA), DM(HDDV), and DM(TCA) are then ranked in 

ascending order from the lowest value to the highest value, and assigned the respective 
designators DM0, DM1, and DM2, from lowest to highest priority, as indicated in 
function block 238. In this case, DM0 = DM(SCA) = -0.8; DM1 = DM(HDDV) = 0; and 
DM2 = DM(TCA) = +0.3. 

25 In accordance with the step of function block 240, the chosen output vector is that 

which has the minimum DM (note that M0 and Ml may be negative values). 
Determination of the output reliability vector (RVO) is made by arriving at the reliability 
measure for each of the six different bits: M0, Ml, M2, MX, M3 or M4, MY, and all 
other bits J. In this particular example, the third scenario is used, since DM(SCA) is the 

30 minimum distance metric, and DM(HDDV) is the 2 nd minimum distance metric. 
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RVO(M0, i.e., bit 16) - DM1 - DMO = DM(HDDV) - DM(SCA) = 0 - (-0.8) = +0.8; 
RV0(M1, i.e., bit 7) = DM1 - DMO = DM(HDDV) - DM(SCA) = 0 - (-0.8) = +0.8; 
RV0(M2, i.e., bit 1) = DM1 - DMO = DM(HDDV) - DM(SCA) = 0 - (-0.8) = +0.8; 
RVO(MX, i.e., bit 3) = DM1 - DMO = DM(HDDV) - DM(SCA) = 0 - (-0.8) = +0.8; 
RV0(M3 or M4, as per function block 214 which is M4, i.e., bit 12, in this case) 

= DM2 - DM1 = DM(TCA) - DM(HDDV) = 0.3; 
RVO(MY, i.e., bit 14) = DM2 - DM1 = DM(TCA) - DM(HDDV) - 0.3; and 
RVO(J) = RV(M0) + RV(M1) + RV(J) + A,RV(M4) - DMO (where J is all other bit 

positions) = (-0.7) + (-0.4) + RV(J) + X(03) - (-0.8) = - 0.3 + RV(J). 

Completing the example by calculating the output reliabilities for the remaining 
bit positions yields the following values for all bits (where hereinafter RVO(bit 1) is 
denoted RVO(l)): 

RVO(bit 1) = + 0.8; 

RVO(bit 2) = - 0.3 + RV(2) = - 0.3 + 1.1 = + 0.8; 
RVO(bit 3) = + 0.8; 

RVO(bit 4) = - 0.3 + RV(4) = - 0.3 - 0.9 = - 1 .2; 
RVO(bit 5) = - 0.3 + RV(5) = - 0.3 - 1.3 = - 1.6; 
RVO(bit 6) = - 0.3 + RV(6) = - 0.3 + 1.2 = + 0.9; 
RVO(bit 7) = + 0.8; 

RVO(bit 8) = - 0.3 + RV(8) = - 0.3 + 1.0 = + 0.7; 
RVO(bit 9) = - 0.3 + RV(9) = - 0.3 - 0.9 = - 1.2; 
RVO(bit 10) = - 0.3 + RV(10) = - 0.3 +1.7 = + 1.4; 
RVO(bit 1 1) = - 0.3 + RV(1 1) = - 0.3 - 1.1 = - 1.4; 
RVO(bit 12) = + 0.3; 

RVO(bit 13) = - 0.3 +RV(13) = - 0.3 - 1.5 = - 1.8; 
RVO(bit 14) - + 0.3; 

RVO(bit 15) = - 0.3 + RV(15) = - 0.3 + 0.9 = + 0.6; and 
RVO(bit 16) - + 0.8. 
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The output code word is the code word with the maximum correlation or 
minimum metric, which in this example is SCA. Thus the output code word of this 
example, i.e., (1, 1, 1, 0, 0, 1, 1, 1, 0, 1, 0, 1, 0, 0, 1, 1) matches the transmitted code 
word at the beginning of the example. 

5 

(8.4) Extended Hamming Code Example 

In an application using a (7,4) Hamming code, a 4-bit binary message is to be sent 
from a source device to a destination device across a channel medium. As part of the 
encoding scheme of the source device, three parity check bits are appended to the 4-bit 

10 message prior to transmission across the channel. Each of the parity check bits generated 
at the source encoder are calculated in accordance with a number of predetermined 
algebraic equations, each involving a combination of one or more of the message bits. 
When a vector of data is sampled at the destination decoder, these same algebraic 
equations are then used to, again, regenerate the parity bits in accordance with the 

15 received message bits, and to compare these regenerated parity bits with the parity bits of 
the received message. When a difference in parity bits is found, the SISO-TC algorithm 
executes to resolve the errors in favor of the most-likely-transmitted code word. If a 
code word was received at the destination, no parity errors will be detected, implying that 
no problem existed in the transmission process, and calculation of the output reliability 

20 information is all that remains. 

However, 8-bit code words or multiples thereof are more conducive to existing 
communication systems. Therefore, Extended Hamming codes (e.g., (8,4), (16,1 1), etc.) 
are used which include an additional appended parity check bit to check overall parity of 
the 7-bit (7,4) code word. Continuing with the (8,4) Extended Hamming code 

25 application, if what is to be transmitted from the source device is the all-zeros binary 

word 0 0 0 0 0 0 0 0, the four leftmost bits are message (or information) bits, and the 
source encoder adds the four rightmost bits for parity checking. In preparation for 
transmission across the channel to the destination device, each binary symbol of the all- 
zeros word is converted into a voltage (e.g., a logical 1 is transmitted as a +1 volt, and a 

30 logical 0 is transmitted as a -1 volt). Voltage representation of the all-zeros word which 
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is to be transmitted to the destination device is -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0 
(commas are added for clarity). During transmission over the data channel, noise is 
induced into the voltages. 

Assume that what is to be transmitted is the binary word 0 0 0 0 0 0 0 0, with 
5 four leftmost bits of message (or information), and four rightmost parity bits. In 
preparation for transmission across the channel to the destination device, each binary 
symbol of the all-zeros word is converted into a voltage (e.g., a logical 1 is transmitted as 
a +1 volt, and a logical 0 is transmitted as a -1 volt). Assume that the received 8-bit code 
word, in voltage notation, is the following: -0.9 -1.1 -0.8 -1.2 +0.2 +0.1 -1.1 -1.0. 

10 Note that the two underlined positions (positions 5 and 6, from the left) are in error, since 
the positive voltages ultimately translate into two binary "1" bits, which are different 
from the corresponding zero bits of the transmitted all-zeros binary code word. This is 
the basis for further discussion hereinbelow. Note also that since these two symbol 
voltages are the closest to zero of all of the eight symbol voltages (i.e., the "minimum" 

1 5 absolute values), they are the most suspect for being incorrect. That is, the introduction 
of noise from the channel during transmission is more likely to have caused these two bit 
positions to toggle from the correct binary value to the incorrect binary value. 

After receipt of the voltage vector, two vectors are generated; the HDV, called the 
"hard information," and the RV, called the "soft information" or the "reliability 

20 information." The HDV is generated from each of the symbol polarities, where a 
positive voltage maps to a binary "1" and a negative voltage maps to a binary "0," 
resulting in an 8-bit binary received code word of p = 0 0 0 0 1 10 0. Note that 
word p has two bit errors relative to the transmitted binary word, which errors are in the 
positions of the "1" bits. The RV is generated using the magnitude of the voltages 

25 associated with each of the symbol positions. Therefore, the RV is 0.9, 1.1, 0.8, 1.2, 
0.2, 0.1, 1.1, 1.0 (the commas inserted for clarity, only). 

Next, HDD is performed on the binary code word p (i.e., HDV). Assuming that 
HDD of the HDV results in two additional bit positions being in error (positions 3 and 4), 
the resulting 8-bit binary code word is 0 0 1 1 1 1 0 0. This occurs since the regime 

30 in which this particular decoding example is applied, operates on a code having a 
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minimum distance of four (i.e., every code word must differ from every other code word 
by at least four positions). Since the all-zeros code word is also a code word, then any 
code word which is not the all-zeros code word must have at least four "1" bits. Note 
that the hard decision decoder can correct a single bit error, however, it can only take a 
5 guess at a two bit-error event. In this case, only two bit positions will be toggled (i.e., the 
decoder will toggle 0, 1 or 2 positions only, and never more then two, in this example). It 
is not possible to start with two Is, and toggle two positions, and have the result be a 
code word, unless the two positions which are toggled are completely outside the 
original, channel-caused, two bits in error. It is possible that the guess is indeed these 

10 two original erroneous bits (in which case the guess is right and the errors are corrected), 
but it is much more likely that the decoder "added" two more "errors," resulting in a code 
word with four "1" bits, or a code word which differs from the transmitted code word in 
four positions. The SISO-TC algorithm then negates the positions (3 and 4) in the RV of 
those alleged error positions in the HD V, which is called the augmented error RV, or 

15 RVe. The RVe is now 0.9, 1.1, ^8, A2, 0.2, 0.1, 1.1, 1.0. 

Taking a brief departure at this point to discuss some inherent features of linear 
block codes will be informative. The (8,4) Extended Hamming code is based upon the 
(7,4) Hamming code. To arrive at the (8,4) Extended Hamming code, a single parity bit 
(for checking overall parity) is appended to the (7,4) Hamming code. An inherent aspect 

20 of a (7,4) linear block code is that hard decision decoding of such a code will result in 
another code word. This aspect is carried into the (8,4) Extended Hamming code when, 
after decoding the (7,4) word, overall parity is checked, and the appended parity bit is 
"corrected" if necessary to meet the overall parity condition. Additionally, the (8,4) 
Extended Hamming Code has a minimum distance of four; that is, each code word in the 

25 set of code words differs from one another in at least four bit positions. 

Continuing with the example, before analyzing code words other than the first 
possible code word, the bit positions alleged to be in error by HDD, positions 3 and 4, are 
tagged for later reversal. 

At this point, other code words need to be found and tested. Assume that the first 

30 code word (generated by the HDD decoder) is incorrect, or that the HDD failed to find 
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the correct code word. From the previous arguments, it is known that the positions 
alleged to be in error by the HDD, are most likely correct. Therefore, look for the second 
code word to be different from the first code word, in these alleged error positions. Note 
also that these positions have negative values in the RVe vector. 
5 To find the second code word, three conditions need to be satisfied: (1) a code 

word needs to be found which differs from the first code word in four positions; (2) this 
code word needs to have a high probability of being the correct code word; and (3) the 
search must be performed such that the four positions which are toggled result in a code 
word (i.e., just any four positions can not be toggled). 

10 The algorithm continues by finding the positions of the three lowest values in the 

augmented reliability vector RVe. These positions are then toggled. At this point, the 
new binary vector is run through a hard decision decoder (HDD). The HDD will find a 
fourth position. (It is possible to find this fourth position simply by knowing the positions 
of the three lowest values which are to be toggled. Thus, the HDD operation on the new 

15 binary vector would not be necessary). This operation generates a code word which is 
different from the first code word in four positions, thus meeting condition (1). Because 
three of the positions are the positions of lowest value in RVe, the probability of finding 
the correct code word is maximized, thus meeting condition (2). At this point, there 
exists only one other position which can be toggled to result in a code word (condition 

20 (3)). To find this last position, the new bit pattern (first code word with three positions 
toggled) is passed through the hard decision decoder. This decoder will allege an "error," 
which error will be the missing 4 th position, thus, meeting conditions (1) and (3). (Note 
that to find this 4 th position, one could have started with the all-zeros code word, toggled 
the three positions of the three lowest confidences values, and passed this bit pattern 

25 through a hard decision decoder. This process has some advantages in implementation.) 
Having the four positions, the second code word is the first code word with the four 
positions toggled. 

To find a third code word, an assumption has to be made that the first code word 
is not the transmitted code word, and the second code word is not the transmitted code 
30 word. The third code word is found by generating a code word which is different from 
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the first in four positions, and different from the second in four positions. Of the four 
positions toggled in finding the second code word, the two positions with the lowest 
confidence values in RVe are retained. A third position which has the lowest confidence 
in RVe is then found, but it is not one of the remaining two positions of the four positions 
5 toggled in finding the second code word. A bit pattern now exists which is different from 
the first code word in three positions. This bit pattern is then passed through a hard 
decision decoder to find the missing "4 th " position. The resulting code word is 
guaranteed to be different from the first code word in four positions, and the second code 
word in four positions. (Notice that, in general, the five lowest values in RVe need to be 
10 found.) 

Continuing with the example, recall the received real-valued vector is as follows: 

-0.9 -1.1 -0.8 -1.2 ±02 ±01 -1.1 -1.0. 

15 The HDV is a binary word having logical Is and 0s according to the respective symbol 
position polarities, and the RV is comprised of the symbol position magnitudes, both 
indicated as follows: 

HDV = 0 0 0 0 1 1 0 0 

20 and 

RV= 0.9 1.1 0.8 1.2 02 01 1.1 l.O 

After hard decision decoding, the results are: 

25 HDD(HDV) = HDDV = 0 0 11110 0 

and 

RVe= 0.9 1.1 -08 -1.2 02 Ol 1.1 1.0 
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For the second code word, the locations of the three lowest values in RVe are 
positions three, four, and six. 



RVe = 0.9 1.1 -0,8 -1.2 02 OA 1.1 1.0 
5 (lowest values ->) ITT 

To find the 4 th position, place Is in these positions of an otherwise all-zeros 
vector, resulting in: 



10 



0 0 1 1 0 1 0 0. 

Passing this word through a hard decision decoder will allege position five in error. 
Thus, the second code word SCA is HDD with positions three, four, five, and six, 
toggled. 



15 SCA =00000000 

For the third code word, keep the positions of the two lowest values in RVe, and 
find the 3 rd lowest without considering the two highest of the four of finding the second 
code word. 

20 

RVe= 0.9 LI -0.8 -1.2 02 Oi 1.1 1.0 
(two lowest values ->) I i 

(previously considered ->) T t 

25 Positions five and six cannot be looked at, since these were already considered in the 
second code word. The next lowest value is in position one (i.e., 0.9). 

To find the 4 th position, place Is in these three positions (1,3, and 4) of an 
otherwise all-zeros vector: 

1 0 1 1 0 0 0 0. 

30 
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Pass this word through a hard decision decoder, which will then allege position two in 
error (in this example). Thus, the third code word TCA is hard decision decoded with 
positions one, two, three, and four toggled, that is; 

5 TCA - 1 1 1 1 0 0 0 0. 

Correlation, or a metric substantially equivalent to correlation (such as the "difference 
metric" method in Bill's Dissertation, and which simplifies the calculation significantly) 
is used to choose among these three code words. The "correlation value" is the 

10 correlation between the real- valued vector RV and each candidate code word (in -1/+1 
notation). The correlation is calculated as the sum of the products of the respective 
positions of the output code word and its corresponding position in the received real- 
valued vector. The first candidate code word was HDDV (i.e., 0 0 1 1 1 1 0 0), 
which in -1/+1 notation is, -1 -1 +1 +1 +1 +1 -1 -1. The received real-valued vector 

15 was -0.9 -1.1 -0.8 -1.2 ±02 ±0A -1.1 -1.0. 



CV(HDDV) = -l(-0.9) -1(-L1) +l(-0.8) +1(-1.2) +1(0.2) +1(0.1) -l(-l.l) -1(-1.0) = 2.4 
CV(SCA) - -l(-0.9) -l(-l.l) -l(-0.8) -1(-1.2) -1(0.2) -1(0.1) -l(-l.l) -l(-LO) = 5.8 
CV(TCA) = l(-0.9) +1(-1.1) -l(-0.8) -1(-1.2) +1(0.2) +1(0.1) -l(-l.l) -l(-l.O) = 2.4 

20 

The maximum correlation value (i.e., 5.8) is for the second candidate code word (SCA). 
Therefore, the output code word is the all-zeros code word SCA. 

Output = SCA = 0000000 0. 

25 

The output reliability for each bit of the output code word SCA is the difference in 
correlation values between the output code word SCA, and the code word which has a 
different value in the corresponding bit position. The output reliability for the first 
position is defined as the difference between CV(SCA) and CV(TCA) = 5.8 - 2.4 = 3.4, 
30 since SCA was the chosen code word, and TCA is the code word which would have had 
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to been chosen for the first bit position to be different (a logical 1). It so happens that 
this is also the output reliability for the second position as well, and for the same reason. 
So the first two bit positions of the output reliability vector (RVO) can be filled in with 
these two values, as follows: 

5 

+3.4 +3.4 ? ? ? ? ? ? 

The output reliability of the third position is the difference between CV(SCA) and 
CV(HDDV), since SCA was the chosen code word, and HDDV is the code word which 
10 would have had to been chosen for the third bit position to be different (a logical 1). This 
is also the output reliability for the fourth position as well, and for the same reason. So 
positions three and four of the output reliability vector RVO can be filled in as follows: 

+3.4 +3.4 +3.4 +3.4 1111 

15 

To find the output reliability of positions five and six, the difference between the 
correlation value of the chosen code word, and the correlation value of one of the code 
words not chosen, is used. Both of these code words are different in positions five and 
six. If a code word had to be chosen which was different in position five (or six), that 
20 code word with the highest correlation of the remaining two would be chosen. Of the 
two remaining code words, it so happens that, in this example, both have a correlation 
value of 2.4. So, HDDV or TCA could be chosen. In either case, the output reliability 
for positions five and six is 5.8 - 2.4 = 3.4. So positions five and six of the output 
reliability vector RVO can be filled in as follows: 

25 

RVO = +3.4 +3.4 +3.4 +3.4 +3.4 +3.4 ? ? 

The output reliability of the 7 th and 8 th positions are calculated differently. There are no 
code words which "suggest" a one in either of these positions. So the output reliability 
30 vector RVO is computed as follows: 
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RVO(position 7) = CV(SCA) - PseudoCV(of a code word with position 7, which 
doesn't exist) 

= CV(SCA) - (CV(SCA) - 2(-RVe(M2) + -RVe(MX) - RVe(7) - A,RVe(M4)) 

= 2(-RVe(M2) + -RVe(MX) - RVe(7) - XRVe(M4)) 

= 2( -0.1 + -0.2 + 1.1 + X(0.9) ) = 1.6 + 1.8A-; 

and, 

RVO(position 8) = CV(SCA) - PseudoCV(of a code word with position 8, which 
doesn't exist) 

= CV(SCA) - (CV(SCA) - 2(-RVe(M2) + -RVe(MX) + -RVe(8) - XRVe(M4)) 

= 2(-RVe(M2) + -RVe(MX) + -RVe(8) - A,RVe(M4)) 

= 2( -0.1 + -0.2 + 1.0 + 740.9) ) = 1.4 + 1.8A.. 

In an alternative embodiment, if XRVe(M4) is replaced by gamma (y), then 

RVO(position 7) = 2( -0.1 + -0.2 + 1.1 + y ) = 1.6 + 2y 
RVO(position 8) = 2( -0.1 + -0.2 + 1.0 + y )=1.4 + 2y, 

where y is a fixed parameter found by simulation. If y is set to one (in the range 
of what is typical for this example), then: 

RVO(7)= 3.6 
RVO(8)= 3.4 

so, 

RVO = +3.4 +3.4 +3.4 +3.4 +3.4 +3.4 +3.6 +3.4, 
and the output code word is: 

0000000 0. 
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Extensions favorable to the Iterative Decoding Process 

When decoding is performed in an iterative design, very often the output needs to 
be modified. Subsequent "same axis" decodings tend to be correlated. This correlation 
5 reduces the performance of the concatenated code. To eliminate (or at least significantly 
reduce) this problem, the output soft information is replaced with the output minus the 
input. This can be done explicitly, however, since the output for any position J has the 
input (RV(J)) as one of the terms making up the output. This "subtract-off-the-input" 
property can be incorporated into the SISO soft output calculation itself to reduce the 
10 overall complexity (i.e., there is no need to add numbers which will subsequently be 
subtracted off). 

Decoding Method No. 2 

Referring now to FIG. 3, there is illustrated a flow chart of a second decoding 

15 method, according to a disclosed embodiment. This method exploits the fact that in 
turbo decoding, where typically many iterations are performed, the desired output 
information is the difference of the SISO input and SISO output. The reason for this is 
that there is a correlation in the output data to the input data which tends to cause the 
iterative process to converge too rapidly, and often incorrectly. By subtracting the SISO 

20 input from the SISO output, only the difference is used. The difference is scaled, and 
then added with the original vector. The resulting "array" is the input to the next 
decoding pass. This keeps the decoding process from converging erroneously. 
Additionally, given that the desired result is the SISO output minus the SISO input, the 
difference can be computed directly, saving two steps, i.e., the difference is not added in 

25 to calculate the SISO output, so the addition step is eliminated, plus any subsequent 

subtraction steps. The decoding algorithm begins with a function block 300 with a vector 
of sampled channel data. The size (or number of bits) of the sampled vector data is 
determined in accordance with the particular coding implementation, for example, if 
(8,4) block codes are used, the sampled vector will include four samples for each of the 

30 four bits of information and samples for each of the four bits of parity checking. The 
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sampled data, in as much as it is sampled from the physical medium in a bipolar voltage 
format, is then converted into sign-magnitude notation, as indicated in a function block 
302. (Note that implementations in 2's complement can be achieved as well.) Flow 
continues to a function block 304 where the sign data is extracted and placed into the new 
5 HDV. Magnitude data of the received vector is placed into the RV, as indicated in a 
function block 306. 

The following decoding steps are explained with respect to a (16,1 1) extended 
Hamming code, but can be applied to all extended Hamming codes. Extensions can be 
made to codes having a greater Hamming distance including, but not limited to, BCH 

10 codes and Golay codes. The decoding steps for SISO decoding of the (16,1 1) extended 
Hamming code continue by performing HDD on the HDV, as indicated in a function 
block 308. The disclosed decoding algorithm must force decoding of the HDV to 
another code word. This is accomplished with extended Hamming codes by 
complementing the extended bit position (i.e., the parity bit) whenever a parity error is 

15 found. This resulting "corrected" vector is again, designated the HDDV, as indicated in a 
function block 310. Flow continues to a function block 312 where the bit positions of the 
RV which correspond to the alleged bits in error in the HDV, are then 2 ^-complemented 
in the RV. (Note that these corresponding bit positions in the RV are negated, if any 
errors were alleged in the HDDV.) Flow continues to a function block 314 to determine 

20 the positions of the four lowest values in the RV. (The positions found in accordance 
with the step associated with block 3 12 are guaranteed to be part of these four positions.) 
Call these positions M0, Ml, M2, and M3 in order of lowest to highest values, 
respectively. 

A copy of the HDDV is then made, as indicated in a function block 316, and the 
25 bit positions of the three lowest values M0, Ml, and M2 of the four (M0-M3) are then 
complemented, as further indicated in a function block 318. This new vector is 
designated the SCAI vector. Flow continues to a function block 320 where HDD is 
performed on the SCAI vector. The code word output from this HDD process is 
designated the SCA vector. Note the bit position alleged to be in error by the hard 
4 30 decision decoding (one bit position is guaranteed to be found for extended Hamming 
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codes). This bit position alleged to be in error is then denoted as MX, Flow continues to 
a function block 322 where a copy of the HDDV is made. The bit positions of the two 
lowest values MO and Ml are then complemented, as indicated in a function block 324. 
Additionally, complement bit position M3. This vector is than designated the TCAI 
5 vector. Flow is then to a function block 326 to perform HDD on the TCAI vector. The 
output code word is designated the TCA vector, and the positions alleged to be in error in 
the hard decision decoding process are noted (one bit error is guaranteed to be found). 
This new error position is denoted as MY. 

At this point, there exists three candidate code words (or vectors); HDDV, SCA, 

10 and TCA. (Note that TCA may be equal to SCA, if MX = M3 and MY - M2, in which 
case, TCA would be excluded.). Each code word has a DM associated therewith. The 
DM for the HDDV code word is denoted DM(HDDV), and similarly for DM(SCA) and 
DM(TCA). The following definitions are then made, as indicated in a function block 
328: DM(HDDV) = - RV(MO) - RV(M1); DM(SCA) = RV(M2) + RV(MX); and 

1 5 DM(TCA) = RV(M3) + RV(MY). 

Flow continues to a function block 330 where DM(HDDV), DM(SCA), and 
DM(TCA) are calculated, ranked from the lowest to highest value, and assigned to DM0, 
DM1, and DM2, respectively, as indicated in a function block 332. Flow continues to a 
function block 334 where the output vector (HDDV, SCA, or TCA) which has minimum 

20 DM, is chosen. (Note that MO and Ml may be negative values.) Flow is then to a 

function block 336 where the appropriate set of equations are selected for determining 
the output reliability vector RVO, according to the order of the distance metrics DM0, 
DM1, and DM2. The RVO is then generated using a difference of distance metrics 
(DM0, DM1, and DM2) for some of the bit positions, and by using a gamma 

25 approximation for the remaining positions, as indicated by a function block 338. Flow 
then continues to a Stop block. At this point, flow could return processing of the 
decoding algorithm to function block 300 to process the next sampled data vector. 

Selection of RVO is then determined in accordance with the relationship of the 
candidate code word DM's. 
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a) If the minimum distance metric DMO — DM(HDDV), and the 2 nd minimum 
distance metric DM1 = DM(SCA), then: 

RVO(MO) = DM1 - DMO = DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(MO) + RV(M1); 
RVO(Ml) = DM1 - DMO = DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(M0) + RV(M1); 
RVO(M2) = DM1 - DMO - DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(MO) + RV(M1); 
RVO(MX) = DM1 - DMO = DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(MO) + RV(M1); 
RV0(M3) = DM2 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); 
RVO(MY) = DM2 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); and 
RVO(J) = RV(J) + y + RV(MO) + RV(M1), where J is all other positions. 

b) If the minimum distance metric DMO = DM(HDDV), and the 2 nd minimum 
distance metric DM1 = DM(TCA), then: 

RVO(MO) = DM1 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); 
RVO(Ml) = DM1 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); 
RVO(M2) = DM2 - DMO = DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(MO) + RV(M1); 
RVO(MX) - DM2 - DMO = DM(SCA) - DM(HDDV) 

= RV(M2) + RV(MX) + RV(MO) + RV(M1); 
RVO(M3) = DM1 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); 
RVO(MY) = DM1 - DMO = DM(TCA) - DM(HDDV) 

= RV(M3) + RV(MY) + RV(MO) + RV(M1); and 
RVO(J) = RV(J) + y + RV(MO) + RV(M1), where J is all other positions. 
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c) If the minimum distance metric DMO — DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) - DM1 - DMO = DM(HDDV) - DM(SCA) 

= - RV(MO) - RV(M1) -RV(M2) - RV(MX); 
RVO(Ml) = DM1 - DMO = DM(HDDV) - DM(SCA) 

= - RV(MO) - RV(M1) -RV(M2) - RV(MX); 
RVO(M2) = DM1 - DMO = DM(HDDV) - DM(SCA) 

= - RV(MO) - RV(M1) -RV(M2) - RV(MX); 
RVO(MX) = DM1 - DMO - DM(HDDV) - DM(SCA) 

= - RV(MO) - RV(M1) -RV(M2) - RV(MX); 
RVO(M3) = DM2 - DMO = DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) -RV(M2) - RV(MX); 
RVO(MY) = DM2 - DMO = DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) -RV(M2) - RV(MX); and 
RVO(J) = RV(J) + y - RV(M2) - RV(MX), where J is all other positions. 

d) If the minimum distance metric DMO = DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(TCA), then: 

RVO(MO) = DM2 - DMO = DM(HDDV) - DM(SCA) 

= - RV(MO) - RV(M1) - RV(M2) - RV(MX); 
RVO(Ml) - DM2 - DMO = DM(HDDV) - DM(SCA) 

= - RV(M0) - RV(M1) - RV(M2) - RV(MX); 
RVO(M2) = DM1 - DMO - DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) - RV(M2) - RV(MX); 
RVO(MX) = DM1 - DMO = DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) - RV(M2) - RV(MX); 
RVO(M3) = DM1 - DMO - DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) - RV(M2) - RV(MX); 
RVO(MY) = DM1 - DMO = DM(TCA) - DM(SCA) 

= RV(M3) + RV(MY) - RV(M2) - RV(MX); and 
RVO(J) = RV(J) + y - RV(M2) - RV(MX), where J is all other positions. 
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e) If the minimum distance metric DMO = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) = DM1 - DMO = DM(HDDV) - DM(TCA) 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY); 
RVO(Ml) = DM1 - DMO = DM(HDDV) - DM(TCA) 

- - RV(MO) - RV(M1) - RV(M3) - RV(MY); 
RVO(M2) = DM2 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); 
RVO(MX) = DM2 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); 
RVO(M3) = DM1 - DMO - DM(HDDV) - DM(TCA) 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY); 
RVO(MY) - DM1 - DMO = DM(HDDV) - DM(TCA) 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY); and 
RVO(J) = RV(J) + y - RV(M3) - RV(MY), where J is all other positions. 

f) If the minimum distance metric DMO = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(SCA), then: 

RVO(MO) = DM2 - DMO = DM(HDDV) - DM(TCA) 

= - RV(M0) - RV(M1) - RV(M3) - RV(MY); 
RVO(Ml) = DM2 - DMO = DM(HDDV) - DM(TCA) 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY); 
RVO(M2) = DM1 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); 
RVO(MX) = DM1 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); 
RVO(M3) = DM1 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); 
RVO(MY) = DM1 - DMO = DM(SCA) - DM(TCA) 

= RV(M2) + RV(MX) - RV(M3) - RV(MY); and 
RVO(J) = RV(J) + y - RV(M3) - RV(MY), where J is all other positions. 
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The constant y is determined by trial and error. A range of values of y's from 
y=5 to y=40 inclusive, has been found to yield good results from many Hamming codes 
and extended Hamming Codes. Clearly, using only one additional decoding instead of 
two would work, albeit at a reduced performance. Extensions to a 4 th and 5 th pass 
5 decoding, and beyond, are possible. 

For codes with higher minimum distances, the technique can be made to work. 
The choice of alternate code word patterns needs to be determined. 

Decoding Method No. 3 

10 Referring now to FIG. 4, there is illustrated a flow chart of a third decoding 

method, according to a disclosed embodiment. The decoding algorithm begins with a 
function block 400 where a vector of channel data is sampled. The size (or number of 
bits) of the sampled vector data is determined in accordance with the particular coding 
implementation, for example, if (8,4) block codes are used, the sampled vector will 

15 include four bits of information and four bits of parity checking. The sampled data, in as 
much as it is sampled from the physical medium in a bipolar voltage format, is then 
converted into sign-magnitude notation, as indicated in a function block 402. (Note that 
implementations in 2's complement can be achieved as well.) Flow continues to a 
function block 404 where the sign data is extracted and placed into the HDV. Magnitude 

20 data of the received vector bits is placed into the RV, as indicated in a function block 
406. 

The following decoding steps are explained with respect to a (16,1 1) extended 
Hamming code, but can be applied to all extended Hamming codes. Extensions can be 
made to include codes having a greater Hamming distance including, but not limited to, 

25 BCH codes and Golay codes. The decoding steps for SISO decoding of the (16, 1 1) 
extended Hamming code continue by performing HDD on the HDV, as indicated in a 
function block 408. The disclosed decoding algorithm must force decoding of the HDV 
to another code word. This is accomplished with extended Hamming codes by 
complementing the extended bit position (i.e., the parity bit) whenever a parity error is 

30 found. This resulting "corrected" vector is designated the HDDV, as indicated in a 
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function block 410. Flow continues to a function block 412 where the bit positions of the 
RV which correspond to the alleged bits in error in the HDV, are then 2's complemented 
in the RV. (Note that these corresponding bit positions in the RV are negated, if any 
errors were alleged in the HDDV.) Flow continues to a function block 414 to determine 
5 the positions of the four lowest values in the RV. (The positions found in the step 
associated with function block 408 are guaranteed to be part of these four positions.) 
Call these positions M0 5 Ml, M2, and M3 in order of lowest to highest values, 
respectively. 

A copy of the HDDV is then made, as indicated in a function block 416, and the 

10 bit positions of the three lowest values MO, Ml, and M2 of the four (M0-M3) are then 
complemented, as further indicated in a function block 418. This new vector is 
designated the SCAI vector. Flow continues to a function block 420 where HDD is 
performed on the SCAI vector. The code word output from this HDD process is 
designated the SCA. The bit position alleged to be in error is then noted by the hard 

15 decision decoding (one bit position is guaranteed to be found for extended Hamming 
codes). This bit position alleged to be in error is then denoted as MX. Flow continues to 
a function block 422 where a copy of the HDDV is made. The bit positions of the two 
lowest values MO and Ml are then complemented, as indicated in a function block 424. 
Additionally, complement bit position M3, and call this vector the TCAI vector. Flow is 

20 then to a function block 426 to perform HDD on the TCAI vector. The output code word 
is designated the TCA vector, and the positions alleged to be in error in the HDD process 
are noted (one bit error is guaranteed to be found for extended Hamming Codes). This 
new error position is denoted as MY. 

At this point, there exists three candidate code words (or vectors); HDDV, SCA, 

25 and TCA (TCA may be equal to SCA, if MX = M3 and MY = M2). Each code word has 
a distance metric associated therewith. The DM for the HDDV code word is denoted 
DM(HDDV), and similarly for DM(SCA) and DM(TCA). The following definitions are 
then made, as indicated in a function block 428: DM(HDDV) - - RV(M0) - RV(M1); 
DM(SCA) - RV(M2) + RV(MX); and DM(TCA) = RV(M3) + RV(MY). If, however, 

30 M3 = MX, then there is no TCA vector, and the third code word is excluded. 
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Flow continues to a function block 430 where DM(HDDV), DM(SCA), and 
DM(TCA) are calculated, ranked from the lowest to highest value, and assigned to DM0, 
DM1, and DM2, respectively, as indicated in a function block 432. Flow continues to a 
function block 434 where the output vector which has minimum DM (HDDV, SCA, or 
5 TCA), is chosen. (Note that MO and Ml may be a negative value.) Flow is then to a 
function block 436 where the appropriate set of equations are selected for determining 
the output reliability vector RVO, according to the order of the distance metrics DM0, 
DM1, and DM2. The RVO is then generated using a difference of distance metrics 
(DM0, DM1, and DM2), subtracting out the input for some of the bit positions, and using 

10 a gamma approximation for the remaining positions, as indicated by a function block 
438. Flow then continues to a Stop block. At this point, flow could return processing of 
the decoding algorithm to function block 400 to process the next sampled data vector. 

Selection of RVO is then determined in accordance with the relationship of the 
candidate code word DM's. The input reliability for any bit position RV(M?) input , is the 

15 soft information input. That is, the subscript "input" refers to the reliability vector before 
the HDD process. If the output code word is to result in a bit position being different 
from the input bit pattern, then this input value must be negated prior to the "subtraction" 
stage. 

a) If the minimum distance metric DM0 = DM(HDDV), and the 2 nd minimum 
20 distance metric DM1 = DM(SCA), then: 

RVO(MO) = DM1 - DM0 - RV(M0) input = DM(SCA) - DM(HDDV) - RV(M0) input 

- RV(M2) + RV(MX) + RV(M0) + RV(M1) - RV(M0) input 
= RV(M2) + RV(MX) + RV(M1) 

= RV(M1) + DM(SCA); 
25 RVO(Ml) - DM1 - DM0 - RV(M0) input = DM(SCA) - DM(HDDV) - RV(Ml) input 

- RV(M2) + RV(MX) + RV(M0) + RV(M1) - RV(Ml) input 
= RV(M2) + RV(MX) + RV(M0) 

= RV(M0) + DM(SCA); 
RVO(M2) = DM1 - DM0 - RV(M2) input = DM(SCA) - DM(HDDV) - RV(M2) input 
30 = RV(M2) + RV(MX) + RV(M0) + RV(M1) - RV(M2) input 
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= RV(MX) + RV(MO) + RV(M1) 
= RV(MX) - DM(HDDV); 
RVO(MX) = DM1 - DM0 - RV(MX) input = DM(SCA) - DM(HDDV) - 
RV(MX) input 

= RV(M2) + RV(MX) + RV(MO) + RV(M1) - RV(MX) input 

= RV(M2) + RV(MO) + RV(M1) 

= RV(M2) - DM(HDDV); 
RVO(M3) = DM2 - DM0 - RV(M3) input = DM(TCA) - DM(HDDV) - RV(M3) input 

= RV(M3) + RV(MY) + RV(MO) + RV(M1) - RV(M3) input 

= RV(MY) + RV(M0) + RV(M1) 

= RV(MY) - DM(HDDV); 
RVO(MY) = DM2 - DM0 - RV(MY) input = DM(TCA) - DM(HDDV) - 
RV(MY) input 

= RV(M3) + RV(MY) + RV(MO) + RV(M1) - RV(MY) input 

= RV(M3) + RV(MO) + RV(M1) 

= RV(M3) - DM(HDDV); and 
RVO(J) = y - DM(HDDV), where J is all other positions. 
The general pattern is that the soft input value does not appear in the soft output 
value calculation for any bit position. In some cases (like MO and Ml), a negative 
version of the value may be added in. However, in the end, it should always cancel out. 

b) If the minimum distance metric DM0 = DM(HDDV), and 
the 2 nd minimum distance metric DM1 - DM(TCA), then: 

RVO(MO) = DM1 - DM0 - RV(M0) input = DM(TCA) - DM(HDDV) - RV(M0) input 

= RV(M3) + RV(MY) + RV(M0) + RV(M1) - RV(M0) input 

= RV(M3) + RV(MY) + RV(M1); 
RVO(Ml) = DM1 - DM0 - RV(Ml) input = DM(TCA) - DM(HDDV) - RV(Ml) input 

= RV(M3) + RV(MY) + RV(M0) + RV(M1) - RVCMl)^ 

= RV(M3) + RV(MY) + RV(M0); 
RVO(M2) = DM2 - DM0 - RV(M2) input = DM(SCA) - DM(HDDV) - RV(M2) input 

= RV(MX) - DM(HDDV); 
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RVO(MX) = DM2 - DM0 - RV(MX) input = DM(SCA) - DM(HDDV) - 
RV(MX) input 

= RV(M2) - DM(HDDV); 
RVO(M3) = DM1 - DM0 - RV(M3) input = DM(TCA) - DM(HDDV) - RV(M3) input 

= RV(MY) - DM(HDDV); 
RVO(MY) = DM1 - DM0 - RV(MY) input = DM(TCA) - DM(HDDV) - 
RV(MY) input = RV(M3) - DM(HDDV); and 

RVO(J) = y - DM(HDDV), where J is all other positions, 
c) If the minimum distance metric DM0 = DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) = DM1 - DM0 - RV(M0) input = DM(HDDV) - DM(SCA) - RV(M0) input 

= - RV(M0) - RV(M1) - DM(SCA) - RV(M0) input ; 

= - RV(M1) - DM(SCA); 
RVO(Ml) - DM1 - DM0 - RV(Ml) inpilt = DM(HDDV) - DM(SCA) - RV(Ml) mput 

= - RV(M0) - RV(M1) - DM(SCA) - RV(Ml) input 

- - RV(M0) - DM(SCA); 
RVO(M2) = DM1 - DM0 = DM(HDDV) - DM(SCA) - RV(M2) input 

= - RV(M0) - RV(M1) - DM(SCA) + RV(M2) input 

= - RV(M1) - RV(MX) - RV(M0); 
RVO(MX) = DM1 - DM0 - RV(MX) input = DM(HDDV) - DM(SCA) - 
RV(MX) input 

= - RV(M0) - RV(M1) - DM(SCA) + RV(MX) input 

= - RV(M1) - RV(M2) - RV(M0); 
RVO(M3) = DM2 - DM0 - RV(M3) input = DM(TCA) - DM(SCA) - RV(M3) input 

= RV(M3) + RV(MY) - DM(SCA) - RV(M3) input 

= RV(MY)-DM(SCA); 
RVO(MY) = DM2 - DM0 - RV(MY) input = DM(TCA) - DM(SCA) - RV(MY) input 

= RV(M3) + RV(MY) - DM(SCA) - RV(MY) input 

= RV(M3) - DM(SCA); and 

and 
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RVO(J) = y - DM(SCA), where J is all other positions. 

d) If the minimum distance metric DM0 = DM(SCA), and the 2 nd minimum 
distance metric DM1 = DM(TCA), then: 

RVO(MO) = DM2 - DM0 - RV(M0) input = DM(HDDV) - DM(SCA) - RV(M0) input 

= - RV(MO) - RV(M1) - DM(SCA) - RV(M0) input 

= - RV(M1) - DM(SCA); 
RVO(Ml) = DM2 - DM0 - RV(Ml) input = DM(HDDV) - DM(SCA) - RVfMl)^ 

= - RV(MO) - RV(M1) - DM(SCA) - RV(Ml) input 

= - RV(MO) - DM(SCA) - RV(Ml) input ; 
RVO(M2) = DM1 - DM0 - RV(M2) input = DM(TCA) - DM(SCA) - RV(M2) jnput 

= RV(M3) + RV(MY) - DM(SCA) - RV(M2) input 

= RV(M3) + RV(MY) - RV(M2) - RV(MX) - RV(M2) input 

= RV(M3) + RV(MY) - RV(MX); 
RVO(MX) = DM1 - DM0 - RV(MX) input = DM(TCA) - DM(SCA) - RV(MX) input 

= RV(M3) + RV(MY) - DM(SCA) - RV(MX) input 

= RV(M3) + RV(MY) - RV(M2) - RV(MX) - RV(MX) input 

- DM(TCA) - RV(M2); 
RVO(M3) = DM1 - DM0 - RV(M3) input = DM(TCA) - DM(SCA) - RV(M3) input 

= RV(M3) + RV(MY) - DM(SCA) - RVCND)^ 

= RV(MY) - DM(SCA); 
RVO(MY) = DM1 - DM0 - RV(MY) input = DM(TCA) - DM(SCA) - RV(MY) input 

= RV(M3) + RV(MY) - DM(SCA) - RV(MY) input 

= RV(M3) - DM(SCA); and 
RVO(J) = y - DM(SCA), where J is all other positions. 

e) If the minimum distance metric DM0 = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(HDDV), then: 

RVO(MO) = DM1 - DM0 - RV(M0) input = DM(HDDV) - DM(TCA) - RV(M0) input 
= - RV(M0) - RV(M1) - DM(TCA) - RV(M0) input 
= -RV(Ml)-DM(TCA); 

RVO(Ml) = DM1 - DM0 - RV(Ml) input = DM(HDDV) - DM(TCA) - RV(Ml) input 



Atty. Dkt. No. 74448/07215 



40 



= - RV(MO) - RV(M1) - DM(TCA) - RV(Ml) input 

= - RV(MO) - DM(TCA); 
RVO(M2) = DM2 - DMO - RV(M2) input = DM(SCA) - DM(TCA) - RVCME)^ 

= RV(M2) + RV(MX) - DM(TCA) - RV(M2) input 

= RV(MX) - DM(TCA); 
RVO(MX) = DM2 - DMO - RV(MX) input = DM(SCA) - DM(TCA) - RV(MX) input 

= RV(M2) + RV(MX) - DM(TCA) - RV(MX) input 

= RV(M2) - DM(TCA); 
RV0(M3) = DM1 - DMO - RV(M3) input = DM(HDDV) - DM(TCA) - RV(M3) input 

= - RV(MO) - RV(M1) - DM(TCA) - RV(M3) input 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY) - RV(M3) input 

= DM(HDDV) - RV(MY); 
RVO(MY) = DM1 - DMO - RV(MY) mput = DM(HDDV) - DM(TCA) - 
RV(MY) input 

= - RV(MO) - RV(M1) - DM(TCA) - RV(MY) input 

= - RV(MO) - RV(M1) - RV(M3) - RV(MY) - RV(MY) input 

= DM(HDDV) - RV(M3); and 
RVO(J) = y - DM(TCA), where J is all other positions, 
f) If the minimum distance metric DMO = DM(TCA), and the 2 nd minimum 
distance metric DM1 = DM(SCA), then: 

RVO(MO) = DM2 - DMO - RV(M0) inpilt = DM(HDDV) - DM(TCA) - RV(M0) input 

= - RV(MO) - RV(M1) - DM(TCA) - RV(M0) input 

= - RV(M1) - DM(TCA); 
RVO(Ml) = DM2 - DMO - RV(Ml) input = DM(HDDV) - DM(TCA) - RV(Ml) input 

- - RV(M0) - RV(M1) - DM(TCA) - RV(Ml) input 

= - RV(MO) - DM(TCA); 
RVO(M2) = DM1 - DMO - RV(M2) input = DM(SCA) - DM(TCA) - RV(M2) input 

= RV(M2) + RV(MX) - DM(TCA) - RV(M2) input 

= RV(MX) - DM(TCA); 
RVO(MX) = DM1 - DMO - RV(MX) input = DM(SCA) - DM(TCA) - RV(MX) input 
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= RV(M2) + RV(MX) - DM(TCA) - RV(MX) input 

= RV(M2)-DM(TCA); 
RV0(M3) = DM1 - DMO - RV(M3) input - DM(SCA) - DM(TCA) - RV(M3) input 

= DM(SCA) - DM(TCA) - RV(M3) input 
5 = DM(SCA) - RV(M3) - RV(MY) - RV(M3) input 

= DM(SCA)-RV(MY); 
RVO(MY) = DM1 - DMO - RV(MY) input = DM(SCA) - DM(TCA) - RV(MY) input 

= DM(SCA) - DM(TCA) - RV(MY) input 

= DM(SCA) - RV(M3) - RV(MY) - RV(MY) input 
1 0 = DM(SCA) - RV(M3); and 

RVO(J) = y - DM(TCA), where J is all other positions. 

The constant y is a multiplying constant which is determined by trial and error. A 

range of values of y's from y=5 to y=40 has been found to yield good results from many 
Hamming codes and extended Hamming Codes. Clearly, using only one additional 
15 decoding instead of two would work, albeit at a reduced performance. Extensions to a 4 th 
and 5 th pass decoding, and beyond, are possible. 

For codes with higher minimum distances, the technique can be made to work. 
However, the choice of alternate code word patterns needs to be determined. 



20 Parameter Estimation 

Two parameters, X and y, have been discussed in the previous sections. The 
method of finding these parameters is largely by trial and error. The technique begins 
with a simulation model of the system. This involves a data source, an encoder, a symbol 
mapper, a noise-adding process (typically White Gaussian Noise), and a decoder, 

25 operating in accordance with the algorithm disclosed hereinabove. All of this can be 
accomplished in a computer program. Performance evaluation of the decoder (with its 
respective choice of parameters) is accomplished by comparing the decoded output data 
with the input data from the data source. The goal is to minimize the percentage of 
output bits in error for a given noise energy (i.e., average square value of the noise 

30 generating process). The best choice of gamma (y) is related to the size of the signal as 
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seen at the input of the decoder, A starting value is typically 3 times this value, with 
smaller values tried until an optimum is reached. A value of y = 1 to 2 times the average 
input amplitude has yielded good results. Optimizing lambda (X) is less sensitive to the 
decoder input strength. Lambda in the range of k = 2 to 5 has yielded good performance, 
5 Those skilled in the art will appreciate that the invention can be carried out 

entirely in software, in dedicated hardware, or a combination of the two. The specific 
hardware requirements will be determined by the complexity of the block code being 
utilized, as well as the particular aspects of the decoding process used. For example, the 
computing power required to perform the output reliability vector calculations, and the 

10 decoding processes, in general, will determine the application format. One approach for 
carrying out the processes would be the use of address translation logic in conjunction 
with a general purpose processor. Alternatively, application specific integrated circuits 
(ASICs) could be designed to execute the functions identified herein with respect to the 
disclosed algorithms, including address translation logic, vector XOR operations, 

15 additions, subtractions and compares. The disclosed novel embodiments could also be 
implemented into a Field Programmable Gate Array (FPGA) for dedicated use, and many 
other types of programmable logic devices. 

While the invention has been shown and described with respect to specific 
embodiments thereof, this is for illustrative purposes rather than limitation, and other 

20 variations and modifications of the specific embodiments herein shown and described 
will be apparent to those skilled in the art within the intended spirit and scope of the 
invention as set forth in the appended claims. 
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